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Abstract 


When stimulated by a very large number of Poisson-like presynaptic current input spikes, the temporal 
dynamics of the soma membrane potential V(t) of a leaky integrate-and-fire (LIF) neuron is typically modeled 
in the diffusion limit and treated as a Ornstein-Uhlenbeck process (OUP). When the potential reaches a 
threshold value 0, V(t) = 0, the LIF neuron fires and the membrane potential is reset to a resting value, 
Vq < 0, and clamped to this value for a specified (non-stochastic) absolute refractory period T r > 0, after 
which the cycle is repeated. The time between firings is given by the random variable Tf = T r +T where T 
is the random time which elapses between the “unpinning” of the membrane potential clamp and the next, 
subsequent firing of the neuron. The mean time-to-fire, Tf = E (Tf) = T r + E(T) = T r + T, provides a 
measure p of the average firing rate of the neuron, 


P 



1 

T r +T 


This note briefly discusses some aspects of the OUP model and derives the Siegert formula giving the firing 
rate, p = p{Io) as a function of an injected current, Iq- This is a well-known classical result and no claim to 
originality is made. The derivation of the firing rate given in this report, which closely follows the derivation 
outlined by Gardiner |6], minimizes the required mathematical background and is done in some pedagogic 
detail to facilitate study by graduate students and others who are new to the subject. Knowledge of the 
material presented in the first five chapters of Gardiner SB] should provide an adequate background for 
following the derivation given in this note. 


1 Background 


Simple phenomenological models of the dynamical depolarization behavior of the membrane potential, V(t ), 
of a neuron often separate its behavior into two phases: (1) an analytically tractable “subthreshold” behavior, 
which describes the behavior until a threshold membrane potential value, V(t) = 0 , is attained. (2) At which 
point an action potential spike is triggered, followed by an absolute refractory period after which the cycle 
repeats itself. 

In particular, the leaky integrate and fire (LIF) model assumes that the depolarization dynamics in the 
subthreshold regime of the part of the soma responsible for spike generation behaves like a linear RC circuit, 


LIF : jV(t) = - V(t) - V r ) + 2 I(t ), 


t = RC 


(1) 
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This assumption is consistent with the fact that averaging over a length of a cylindrical neuron membrane 
yields this behavior as a low-order approximation ^20[ [22] . For mammalian neurons a typical time-constant 
value is r ~ 5-10 msec [201 118] . The constant membrane reversal (aka, equilibrium) potential is denoted by 
V r . 

Notwithstanding the gross simplification that occurs from the use of the LIF, additional significant 
approximation issues occur due to the nature of the stochastic assumptions that are made on the afferent 
currents which comprise the components of the membrane current I. Generally we can write, 

I(t) = I e (t ) + lint + Isyn, 

where J e (i) is an externally injected current for experimental or control purposes, /i nt represents internal or 
internal noise which is generally neglected!]] while / syn represents the summed effect of all of the afferent 
“upstream” neurons which are sending spikes to the neuron across synaptic clefts. Ignoring the intrinsic 
noise and treating the injected noise as constant on the time-scale of interest, I{t) = Iq, we have, 

-^syn 

I(t) = Iq + I S yn = A) + ^ ' e jlj(t) , (2) 

1=1 

where j indexes one of the N aun synapses, I jit) is a current induced at the j synapse by presynaptic 
stimulation, and ej is the synaptic efficacy of the j synapse which is positive for input from an excitatory 
presynaptic neuron and negative for an inhibitory presynaptic neuron. As many researchers have noted 
n n m uti m mil n] at the finest time scale one cannot ignore the fact that each Ij(t) is effectively a 
spike traino However it is much more difficult to analyze a spiking stimulus than one that has continuous 
sample paths. 

For this reason, as discussed in the aforementioned references, it is commonly argued that for neuronal 
ensembles that operate in the limit of high impinging spiking rates (relative to the membrane time constant) 
and small per-spike efficacies (relative to the magnitude of the spiking threshold magnitude) one can approx¬ 
imate a spiking point process which is assumed to have independent increments by a diffusive, continuous 
sample path Wiener process (aka Brownian motion). And indeed, such arguments can at times be made 
rigorous BMHElEa- The diffusion approximation is made by matching the mean and variance of a input 
spike train to the drift (local mean) and intensity (local variance) of a Wiener process. In particular, if each 
of the input current spike trains represented by I jit) is a stationary poisson renewal process with rate A j, 
we have (see, e.g., El]), 

Isyn = E{/ syn (i)} = ^ ] e j j an d S syn = Var{/ Syn (t)} = ^ ( 6, Aj (3) 

3 3 

The practical reasonableness of approximating / syn (t) by a Wiener process with this (local) mean and variance 

is discussed in mm 

An additional problem arises because in order to model / sy „ by a continuous sample path Wiener pro¬ 
cess, it should be an independent increment process. However, there are capacitive dynamics at work in the 
synapses which induce correlations. To rigorously model such effects is onerous, so an additional approxi¬ 
mation is usually made. In addition to assuming that the spike trains impinging on the soma are a Wiener 
process, it is also assumed that the capacitive time constants at the synapses are fast compared to the time 
constant of the soma membrane. This assumption can also be problematic (see the discussions in puna). 
Suffice it to say, that in this note we do make the following huge simplifications for purposes of mathematical 
tractability: 

1 Internal, intrinsic noise is thermal noise (Johnson or Nyquist noise), “shot noise” (due to ions clumping up as they pass 
through channels) and channel noise due to the stochastic natures of the opening and closing of large numbers of channel pores 
on the neuronal membrane. Even taken collectively, such noise affects are usually (but not always) of low order compared to 
the other terms. 

2 The resulting model is known as the Stein Model [1611171 [2U \22\ . 
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• We assume that we can model the firing behavior of a neuron by the simple LIF model given by Eq. ©■ 

• We assume that the collective effect of the presynaptic spike trains impinging on the neuron can be 
model by an independent increment Wiener process. 

• We assume that the capacitive effects of synaptic and dendritic accumulation and processing of the 
spike trains are negligible. 


To assemble the above pieces into the complete model which we will use in the sequel, define the zero 
mean process and unit variance process, 

Isyn(t) = U(t) ~ Isyn) > 

<5syn ' ' 

so that, 


^syn(t) — Lyn T 1 


’syn^syn (f) ■ 


(4) 


Combinging Eq.s CO, © O we have, 


S y( ‘> = 


Lt 

q 1 s yn 


In — 


1 

T 

0.1= K 


V(t) + 




>(*)■ 


Q'(V')=ao+Q;i V 


(5) 


Thus, 


dV(t)=a(V(t)) + ^pdI syn (t). 


To gain a further degree of abstraction, we set X = V and W = I syn (t) where W denotes the standard (zero 
mean and unit intensity) Wiener process. More generally, /3 can also depend on the state X(t), f) = f3(X). 
The model, 


dX(t) = a(X(t)) + Vl3{X{t)) dW(t), 


( 6 ) 


is known as a stochastic differential equation 0 [231 and has to be interpreted according to the rules of a 
stochastic calculusH Our particular model with an affine drift term 


a(X) = ao — a\X = n — kX, a\ = k > 0, 


(7) 


and state-independent intensity , 

ffiX) = = a 2 > 0, 

is known as the Ornstein-Uhlenbeck process (OUP), 

dX (t) = p — k X (t) + a dW(t). 


( 8 ) 

(9) 


If in addition a firing threshold with reset (after a possible refractory period) is enforced, we obtain the OUP 
Leaky integrate-and-fire model, which we also refer to as the OUP/LIF neuron. 

The LIF neuron fires when V ( t ) = 6. The first-passage time to threshold, Tg, beginning from a membrane 
voltage reset value V(to) = vo at initial time t = 0 is defined by, 

Tg = Tg(vo) = inf {t \ V(t) = 9, V(t 0 ) = v 0 < 9}. 

3 The standard ones being the Ito Calculus and the Stratonovic Calculus 0(22. This distinction vanishes for the Ornstein- 
Uhlenbeck process (OUP), which is the situation under consideration. Because our analysis is based on the use of the Fokker- 
Planck diffusion equations, the stochastic calculus is not used in this note. 
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Note that under our model, T is a random variable. For the model under consideration in this note, i.e. the 
Ornstein-Uhlenbeck process (OUP), we desire to know if the neuron will fire in finite time with probability 
one as well as the mean time to fire. Note that if there is a finite probability that the neuron will never fire in 
finite time, then the mean time to fire must be infinite as T = oo will have a nonzero probability of occurring. 
Thus, as noted by 12 1| one should always first ascertain that a neuron will fire (or not) in finite time with 
probability one. As noted in the abstract (and discussed below) knowledge of the mean time-to-fire provides 
a measure of the firing rate of the neuron. 

Although we have indicated, and will continue to indicate, the dependence of the passage time T on the 
threshold value 9 and the initialization (i.e., the reset) voltage Vq, in fact we are interested in its dependence 
on the injected current Iq which is our parameter of control to affect the firing behavior of the neuron, so 
we will write variously T = Tg{v o) = Tg(v o, Iq) = T(Iq), etc. 

The goal of this note is to demonstrate that the OUP/LIF has a finite passage time with probability one, 
so that the neuron is almost surely guaranteed to fire in a finite time, and to derive its mean first passage 
as a function of the injected current Iq , the reset voltage V(to) = vo, and the threshold value 9 which in 
turn allows us to determine the mean firing rate as a function of these quantities and the absolute refractory 
period T r . At the price of some inelegance, the derivation is kept as simple has possible in order to be 
accessible to a wider range of students and nonspecialistsO An attempt has been made to be thorough and 
detailed, and therefore many derivation steps are given which are often left out of the published literature 
and textbooks. 

2 SDEs, FPEs and the First-Passage Time 

2.1 Stochastic Differential Equations and the Fokker-Planck Equation 

As motivated in the prior discussion, we are interested in the dynamical behavior of the homogeneous 
stochastic differential equation (SDE), 


SDE : dX(t) = a(X(t))dt + ^P{X{t)) dW(t) t > 0 


( 10 ) 


where IT is a standard Wiener process. With the assumption that the initial condition X(0) is (possibly 
degenerate) gaussian and independent of W, this describes the behavior of a continuous sample path, ho¬ 
mogeneous Markov process!! Although we are primarily interested in the behavior of the OUP, we will keep 
the development fairly general and only specialize to the OUP towards the end of the note. 

Eq. Cl provides a local description of the behavior of a diffusion process. There are many global 
solutions consistent with this local behavior, each one determined by the imposition of initial and boundary 
conditions. The Markov process m takes continuous values and therefore, once appropriate initial and 
boundary conditions have been imposed, has a behavior which is described by a transition probability 

4 In particular we avoid, or minimize, the discussion of moment generating functions; Laplace transforms and complex 
analysis; stochastic differential equations; the theory of the Sturm-Liouville problem; the theory of integral equations; and the 
theory of diffusion process boundary conditions, all of which have utility in a rigorous analysis of the first passage time problem 
E 0 BOBS D31 [Efl [HIE]. Knowledge of the behavior of a first-order scalar stochastic dynamical system as described in the 
first 5 chapters of the textbook by Gardiner should provide an adequate background for following the development given in this 
note. 

5 The process is homogeneous because the a(x) and /3(x) are independent of the time, t. 
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density function, p(x,t\xo,to), which uniquely satisfies the Chapman-Komolgorov equation (CKE)|f| 


CKE : p{x,t\xo,to) = J p(x,t\x',t')p(x',t'\xo,to)dx' 


( 11 ) 


and the condition, 


p(x,t) = j p(x,t\x',t')p(x',t')dx', 


for all admissible values of x and t [6]. 

Under mild assumptions on a(-) and /3(-) a distribution which satisfies the CKE also satisfies a differential 
version of the CKE, the (forward) Fokker-Planck equation (FPE) [T21 16] HF1 

d d Id 2 

—p(x,t\xo,to) = --Q^a(x)p(x,t\x 0 ,t 0 ) + --g~ 2 ^{x)p(x,t\xo,to). (12) 

There are many possible solutions, /(a:,f), to the Fokker-Planck equation, 




(13) 


and it is the imposition of initial conditions (at t = to) and boundary conditions that determines which 
particular solution is obtained. In particular, if consistent sets of initial and boundary conditions are correctly 
chosen for the stochastic differential equation Eq. (1101) and for the FPE Eq. (1131) , the solution to Eq. (fl3l) will 
correctly describe the stochastic behavior of Eq. m and satisfy the corresponding CKE o. In particular 
the imposition of the initial condition (IC), 


f{x,t 0 ) = 5(x-x 0 ), (14) 

the unrestricted boundary conditions^ 

f(-oo,t)=p(-oo,t\x 0 ,t 0 ) =0 and f(oo,t)=p(oo,t\x 0 ,t Q ) = 0,. (15) 

and the pdf normalization condition^ 


J p(x,t\x 0 ,t 0 )dx = 1, 


6 We define the conditional density function p(x,t\xo,to) as 

p(x , t\xo, to)dx = Prob{X(t) E (x, x + dx) | X(0) = o?o}, 
with corresponding condition probability distribution, 

P(x, t\xo, to) = f p(x f ,t\xQ : to)dx' = Prob{X(t) < x\X(0) = xo}. 
J — oo 


7 A1so known as the (forward) diffusion equation, the forward Kolmogorov equation, and the Smoluchowski equation. 

8 The equivalence between Eq.s EB and m holds in general under the rules of the Ito stochastic calculus. In general 
the equivalence does not hold under the rules of the Stratonovich calculus. Although most authors and researchers work 
primarily within the Ito formalism (e.g., m [23]) some adhere to the Stratonovich formalism (e.g. 1), which can potentially 
cause confusion when comparing results across various source texts and papers. However, the Ornstein-Uhlenbeck process, 
which is the model under consideration in this note, fortuitously has the same behavior under both the Ito and Stratonovich 
interpretations [6]. 

9 It is possible to place alternative and/or additional conditions on the behavior of the solution f(x,t) at x = ±oo, depending 
on the nature of the solution one is looking for mmm- 

10 Note that the normalization condition is sufficient for the previous boundary conditions at x = d=oo. One reason to decouple 
the two conditions is that under some alternative boundary conditions reasonable solutions can satisfy 

Jp(x,t\xo,to)dx < 1, 

where the loss of probability corresponds to the probability of “aborption.” For a discussion of this subtle point see mi- 
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to the solution of the FPE m will result in a transition density p(x, t\xo, to) that correctly describes the 
stochastic behavior, X(t), t > 0, of Eq. (flOl) . provided the latter has been subjected to the initial condition 
X(to) = xo with no other conditions imposed on A'(i)0 On the other hand, if one applies the initial condition 
f(x, to) = p(x, to), subject to the same boundary conditions, one obtains the solution /( x, t) = p(x, t). Below, 
we will discuss other important solutions to the FPE, as well as to the backward FPE which is to be discussed 
next. 

Within the interior of an admissible open state space region of the SDE (flOl) . the sample paths system 
are all continuous, provided that a(-) and /?(•) are reasonably well-behaved functions of their arguments. 
This means that the solutions to the FPE, and its variants discussed below, will assumed to be continuous 
functions of their space and time arguments within the interior of the state space. Of course, once the 
state X(t) hits the threshold value 9 , which is a boundary of the state space interior, there is a radical, 
discontinuous reset of the state value, 

X{6) X(t 0 )=x o < 0. 


2.2 The Homogeneous Backward and Mixed Fokker-Planck Equations 

The density satisfying the CKE also satisfies the backward Fokker-Planck equation (BFPE), 


BFPE 


Q d 1 

—p{x,t\x 0 ,t 0 ) = a(x)~ — p(x,t\x 0 ,t 0 ) + -/3(x)—^p{x,t\xo,t 0 ) 
oto ox o 2 ox q 


(16) 


In this equation x and t are fixed (i.e., the final state and time are treated as parameters) and xq and to 
are treated independent variables subject to the constraint t 0 < t. If the SDE (flOl) is subject to the initial 
condition X(t 0 ) = Xo and is otherwise unrestricted, then its stochastic behavior is described by the solution 
to (1161) which satisfies the final condition (FC), 


p(x,t\xo,t) = <S(xo - x ). 


This equation is often presented in a slightly different form in the homogeneous case which we are 
considering in this note@ Homogeneity means that for all r, 

p(x, t' + r|x 0 ,^o + r) = p(x, t'\x 0 , f 0 ). 

In particular, for r = —t' 0 , and elapsed time t = t 1 — t' 0 , we have, 

p{x, t\xo, 0) = p(x, 0|xo, -t). 


Taking making the assignments to = —t and t = 0 in the left-hand-side of Eq. (USD. we have, 

d d d d 

-—p(x,t\xo,to) -> - p(x,0\xo,-t) = -p(x,0\x 0 ,-t) = —p(x,t\xo,0). 

Thus if we define, 

g(y,t) =p(x,t[y, o), 

the homogenous BFPE can be rewritten as the mixed Fokker-Planck equation (MFPE), 


(17) 


11 This is called the unrestricted case as no limitations are placed on the values taken by the state X(t) for t > to. Note that 
the general solution involves xq and to as “free parameters.” 

12 It should be noted that a stationary process is necessarily homogenous. (However, a homogenous process is not necessarily 
stationary, unless special initial conditions have been chosen or the process is considered in the asymptotic limit t —>■ oo given 
certain stability assumptions.) 


MFPE : ^9{y,t) = a(y)^g(y,t)+ ^/3(y)-^g{y,t) 
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Note that in Eq. 03 t is the (“forward”) time which has elapsed since the initial time to = 0 and y is the 
value at the (“backward”) initial time, X(0) = t/l^l This variant of the BFPE can be found amply utilized 
in references which primarily focus on the homogenous case (e.g., da EiEi) as well as in other sources (see, 
e.g., Eq. (5.5.5) of [1]). 

Because Eq. C3 has an independent parameter, t, that refers to the future (forward) time and an 
independent parameter that refers to the current (or backward) initial condition y = X( 0), we call Eq. (1171) 
the mixed Fokker-Planck equation (MFPE) in order to distinguish it from the (forward) FPE (ll3l) and the 
BFPE m . It is important to recognize the distinct differences between these three equations. 

Under the appropriately consistent initial and boundary conditions the solutions to the FPE, BFPE, and 
MFPE are equal and describe the stochastic behavior of the SD E (flOl) . In particular, we are interested in 
the initial conditions for the FPEs which correspond to X (0) = i/l 14 l 


ICs : f(x,0)=p(x,0\y,0)=g{y,0)=S(x-y) 


(18) 


As all three variants of the FPE yield the same solution for the transition density function, p{x, t\y, 0), we 
are free to use the one which is of greatest convenience given the nature of a(-), /?(•); and the boundary 
conditions. Note that the solutions to the FPE’s obtained via the use of the ICs (fT51) have tacit dependencies; 
specifically f(x,t) tacitly depends on y while g{y,t) tacitly depends on x. In the sequel it will be useful to 
make these dependencies notationally overt via the definitions, 


f(x,t) = f y (x,t) = f{x,t;y) and g(y,t) = g x (y,t) = g(y,t;x). 


2.3 The First Passage Time 

Consider the case where as long as X(t) £ S, for some open, connected subset of the reals, S C K, its 
dynamical behavior is described by the SDE (flOl) . If S = R, we say that the SDE is unrestricted, whereas if S 
is a proper subset of the reals, we say that it is restricted. A standard choice is an open internal, S a t g = (a, 0). 
Our primary interest is with the case when a —> — oo, 

S = S e — (-oo,6»). 

Because the SDE (flOl) models a diffusion process, it has continuous sample paths, and thus the only way that 
X(t) can exit the admissible state space S is to hit the upper limit 6 at some passage tirnJ^l t', X(t') = 9. 

In the leaky integrate-and-fire (LIF) neuron, as soon as (i.e., the first time that) X(t) “escapes from” 
the region S, the neuron fires (an impulse is generated and sent to downstream neurons) and the dynamics 
represented by the SDE (HOD is “turned off” for a (deterministic) duration, T r chosen to model the absolute 
refractory period of the neuron, after which the clock is reset to zero, t = to = 0, and the neuron is reset to 
its initialization value, X(0) = xq. The process repeats itself indefinitely. 

Once the neuron is reset the dynamical behavior m is allowed to run in an unrestricted manner until 
the threshold 6 is reached. Thus one is interested in the first passage time. This is defined as, 

T = T s (x 0 ) = inf {t| X{t) £ S, X(0) = x 0 £ S} 

13 In terms of the notation used in Eq. (|12|) . Eq. (I17|) is 

d d 1 d^ 

—p(x,t\xo,0) = a(xo)-^—p(x,t\x o ,0) + -^(xo)-^p{x, t\x 0 , 0). 

14 Because of the assumption of homogeneity, henceforth, with no loss of generality, we take to = 0, and henceforth we will 
always take t > 0. 

15 Also known as a hitting time, an exit time, an escape time, or a (gambler’s) ruin time. 
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For our situation of interest, we have 

T = T 0 {x o ) = m{{t\X(t) = 6, X{0) = x 0 <0}. 


The time between firings is given by the random variable Tf = T r + T where T is the random time which 
elapses between the “unpinning” of the membrane potential clamp and the next, subsequent firing of the 
neuron, as just defined. The mean time-to-fire (MTF), 

T f = E (T f ) =T r + E(T) =T r + T, 


provides a measure p of the average firing rate (AFR) of the neuron, 


P 



1 

T r + T 


The primary goal of this note is to derive the mean passage time (MPT), 

T = T e (x o) = E{T e (a;o)}, 


for the Ornstein-Uhlenbeck process (OUP) in a greater degree of detail than is easily 


found in the literature. 


2.4 The MFPE for the Restricted, Subthreshold Dynamics 

Because until the state X(t) reaches the threshold value 9 the local “subthreshold” dynamics are modeled 
by the SDE ijTUjl . its local, stochastic behavior until it escapes from the set S is completely captured by the 
FPEs. Indeed, it’s entire stochastic behavior within the the interior of the region S is captured by the FPEs. 
What distinguishes the global solution to the FPEs for the restricted behavior (X(t) confined to S) from the 
global solution for the unrestricted behavior (X (t) free to take any value in R) are not the FPE’s themselves 
(they after all describe the same local motions within the the interior of the set S for both the restricted 
and unrestricted cases) but rather the boundary conditions which are applied to the FPEs (because the 
difference between the two cases arises when the restricted motion bumps up against the boundary). 

To handle the “bumping up” against the boundary 9 which turns off the dynamics, we imagine that the 
SDE (fTUl) describes the behavior of a brownian motion particle that is absorbed (“vanishes”) as soon as it 
hits the position 9 , never to return againjjf] The theory of boundary conditions for Markov and diffusion 
processes is discussed at length in many places (see, e.g., Eli); suffice it to say that for our purposes it 
is enough to know that the appropriate boundary conditions to enforce in the FPE (THU) and the MFPE 
era if one is interested in solving for the transition density function are the respective absorbing boundary 
conditions, 


ABCs : f(9,t)=p(6,t\xo,0) = 0 and g{9, t) = p(x, t\9, 0) = 0 


(19) 


The first condition says that the probability of being at 9 is zero (because once you step there, you vanish) 
and the second condition says that once you’ve vanished, you never return to anywhere (because you’ve 
vanished for good). Because a diffusion processes is continuous, these conditions imply that, 

Prob{X(f) > 0|X(O) =£o} = 0 and Prob{X(t)|X(0) = x 0 > 9} = 0. (20) 


As described in a variety of sources, the BFPE is particularly useful for solving passage time problems 
El H3 HD E31 El, particularly in the guise of the MFPE variant given by Eq. 1171) above [T5j, !5J El 01 03 In 
particular, the solution of Eq. dab 


d d 1 d ^ 

-Q t 9 x(yfi) = at(y)—g x (y,t) + -P(y)-^g x (y,t), 


16 A nice discussion of this is given in m- 

17 In particular, the development given in this note closely follows that beginning with Eq. (5.5.5) on page 131 of [6]. 


( 21 ) 





subject to the respective initial and boundary conditions, 

9x{y, 0) =6{y-x) and g x {9,t) = 0, Vi (22) 

is equal to the restricted dynamics probability density function, 

9x{y,t) =p(x,t\y,Q), 


where, 


and 


p(x, t\y,0)dx = Prob{V(i) G (x, x + dx), X(t') < 6, Vi' G [0, f]|X(0) = y}, 


/ X fX 

9 x{y,t)dx= p(x,t\y,0)dx 
-oo J — oo 

= Prob{X(i) < X, X(t') < eyt ' G [0,i]|X(0) = y} 


is the probability distribution function for the restricted processes X(t). Because Eq. (|2TT) describes the 
behavior of a continuous sample path diffusion motion, the density function g x {y,t) and the distribution 
function G x (y,t) are continuous functions of x, y and t within the interior of the state space. 


2.5 Moments of the First Passage Time 


The development in this section closely follows that of Section 5.5.1 of [6[. However, as noted i n [2TI there 
are some additional subtle points to be addressed in the derivation of the passage time momentsl 18 ! 


Note from the development in the previous section that 


19 


r s 

Prob {T = T e (y) > t} = Gg{y,t) = / g x (y,t)dx. 

J —OO 


Thus the distribution function of T is given byE 


Qe{y, t) = Prob{T = T e (y) < t) = 1 - Prob{T = T e (y) > t) = 1 - Gg(y, t ). 


Having obtained the passage time distribution function Qg(y , t) we can compute the passage time probability 
density function as l 21 H 22 l 


d d d f e 

q e{y,t) = Qe{y,t) = ~—G e (y,t) = J g x (y,t)dx. 



g^9x(y,t)dx. 


(23) 


From the assumed continuity of G x (y,t) and g x {y,t), Qg(y,t) and qg(y,t) are similarly continuous. 
Note that the condition, 


Qe{y,oo) = lim Qg(y,t) = 1 Vy, (24) 


18 Both [8] and m stress the importance of ascertaining that the probability of a finite passage time be one in order to claim 
that a neuron will reliably fire when stimulated. In addition, a probability-one finite mean passage time provides a technical 
justification for a seemingly minor, yet key, step made in the development given in [6]. 

19 Note that Ge(y,0) = 1 for all y < 6 and that Gg(y,t) = 0 for y >0. In particular, Go(0,t) = 0. 

20 Note that Qo(y , t) = 1 for all y > 6 and that Qe(y , 0) = 0 as X(0) = y < 6. 

21 Note that qg(6, t) = 1 and qg (y, 0) = 0 for y < 6. 

22 For future reference note that Qg(y,t) = qg(y,t)dt and in particular that Qg(y, oo) = qg(y,t)dt , which should have 

a value of one if we are to have a finite passage time occur almost surely. 
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if it holds, means precisely that the first passage time is finite, and therefore neuron will fire in finite time, 
with probability one regardless of the initialization state. Therefore we will spend some time to verify this 
fact for the OUP neuron. 

What does it mean if Qg(y, oo) < 1? It is a property of probability measures that they can be decomposed 
into a continuous part (like Qg(y,t )), represented by continuous probability density functions, like 

d 

qe(y,t) = —Q e (y,t), 

which have no jumps, and a discrete, “atomic” part that places nonzero probability mass on discrete points 
pTOjEl If Q{g(y,oo) = 1, then Q(g(y,t) is a distribution which describes a completely continuous random 
variable, T, that with probability one takes a finite value T = t, 0 < T < oo. On the other hand, if 
Qg(y,oo) < 1, then with probability, 

Gg{y, oo) = 1 - Qg(y, oo), 

the threshold 6 will not be hit in any finite time, which means that there must be a discrete, atomic amount 
(equal to 1 — Qg(y,oo)) of probability mass (conceptually) located at t = oo. In this latter case there is a 
nonzero probability that the neuron will never firer 4 ! 

We do assume that, for each y, lirn^oo Qg(y,t) = Qg(y,oo) converges to a constant value that is inde¬ 
pendent of fEl And if 

n OO 

Qg{y, oo) = / qg(y,t)dt 
Jo 

converges, it must be the case thatF^I 


qg(y,oo) = 0. 


(25) 


Note that Eq. (l24l) is true if and only if 

Gg (y, oo) = lim Gg(y,t) = 0, My. (26) 

£—>•00 

Although condition (l26l) is often assumed to be true 1^1 as noted in [21. this is a key propertjEl that ideally 
should be verified. Of course, (l26l) can always just be assumed to be truef^l Indeed, we will do just that by 
(temporarily) assuming a stronger condition, namely that the convergence of Gg(y,t) obeys, 


lim t n Gg(y, t) = 0, Vy , (27) 

t—> OO 

for specific values of n > 0. When such assumptions are made, we will be very careful to note themFl 

To demonstrate an application of the condition (1271) , we first define the moments of the first passage time 
random variable T = Tg(y) by 

r°° r°° B 

m n = m n (d,y) = E{T n } = J t n q g (y,t)dt = -J t n — Gg(y,t)dt. (28) 

23 There is also a third, mathematically abstract, “singular” part which is not encountered when dealing with phenomena in 
the physical world. 

24 For an example of a model neuron that has a nonzero probability of never firing, see the example on page 142 of ED- 
25 We prove later that Qo(y, oo) < 1. 

26 Thus we have that qo(y , 0) = qe(y, oo) = 0 for y < 6 . We can have qo(y, oo) = 0 and yet have a nonzero probability mass at 
t = oo because qo(y, t) represents the purely continuous part of the T-distribution. It is unfortunately the case that egregiously 
using q$(y, oo) in place of the more accurate limt—^oo qg(y,t) can be misleading: qg(y, oo) does not represent probability mass 
at infinity , but rather the probability density on the way to infinity. 

27 For example, see Equation (5.5.16) of [6]. 

28 Equivalent to the probability one finite passage time condition m- 

29 And then hopefully verified after the fact, thereby demonstrating that a self-consistent derivation has occurred. 

30 Eventually we will replace the condition m with the finite moments condition 03. 
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Note, in particular, that the “zeroth moment”, mo, has already been encountered, 

m 0 (6, y ) = Q s (y, oo) = 1 - G g (y, oo), 

and gives the total probability that the first passage time from the initial state y is finite. As we have noted, 
m o(6,y) = 1 for all y Gg(y,oo)=0 for all y. 


To compute higher order moments, m n (9,y) from Eq. (1281) . it is useful to note that, 

—t n G g (y,t)dt = t n —Gg(y,t)dt + nt n ~ 1 G g (y,t)dt 
ot ot 


so that integrating the last integral on the far right hand side of (|28|) by parts yields 

pOO 

m n (0, y) = n / t n ~ 1 Gg(y,t,)dt - lim t n Gg(y, t) + lim t n Gg(y, t). 

J q t—too i—)-0 

For n = 0, this yields, 

nio(0, y) = Gg(y, 0) - Gg(y , oo) = 1 - Gg(y , oo), 
as expected. For n > 1, we have, 


pOO 

i(9,y) =n t n ~ 1 Gg(y, t)dt — lim t n Gg(y,t), 

Jo ‘-*- 00 


(29) 


(30) 


which, in turn, gives 

m n (9,9) = 0 for all t> 1. 

Finally, note that by invoking condition (l27l) . Eq. (l30l) becomes the very useful relationship, 


Condition (l27l) 


p OO 

i(9,y)=n t n ~ 1 Gg{y, t)dt for n > 1, 
Jo 


(31) 


Inspired by Eq. (l23l) . integrate every term in Eq. m by — /_ (• )dx to obtain the equation, 

de(y,t) = -a(y)-^Gg(y,t) - ^P(y)-^Gg{y,t). 

Now differentiate every term by t , 

Finally, integrate every term by / 0 °°(- )dt, 

r°° d d r°° ( d \ 1 d 2 r°° ( d \ 

l dt q,(v ' m = aiy) a-yj a {~ai aa{y ' t T t ' 


qe(y,°°)-qe(y,0)=o 


qe{y,t) 


qe{y,t) 


(32) 


(33) 


m 0 (S,y) 


m 0 (S,y) 


to obtain, 


o = a(y)—m 0 {9 1 y) 




(34) 
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Eq. (13-0) is to be solved for the finite passage time probability subject to the boundary conditions, 

lim mo(6, y) = ino(9, — oo) = 0 and mo(9,9) = l. (35) 

y-y —oo 


Setting, 


we have, 


or 


m' 0 (9,y) = —mo(0,y), 




Integrating one more timel^l 

= C, + ( JtaC„/ exp{- 2 / 
Invoking the boundary conditions (1351) yields the answer, 


m o(0,Z/)= lim 


H 

{-*"{%]& ] 

\dy" 

9 i 

f V " ( !\ ] 

1 

/exp j 

y 2 /wi*'J 

> dy" 


< 1 for y < 9. 


(36) 


Note we have verified the claim made earlier that mo(9,y ) = Qg{y : oo) < 1. If is apparent that if a(y) and 
/3(y) are such that the limit of the right hand side of Eq. (l36l) is one, thenf^l 

n*o{9,y) = Qe(y,oo) = 1 <(=> Gg{y, oo) = 0 (37) 

for all y. and then with probability one the first passage time is finite. We will see below that this is true 
for the OUP0 

Now assume that condition holds for n = 1, 


lim t Gg(y, t) = 0, My. 

£->-oo 

Then (1311) holds for n = 1, yielding the following expression for the mean first passage time, 

pOO 

E{T e (y)}=m 1 (6,y)= G e {y,t)dt. (38) 

Jo 

Next integrate all terms in Eq. (l32l) by / 0 °°( • )dt to obtain, 

qeilJi t)dt = a(y)-^~ j Gg(y,t)dt + J G e (y,t)dt. 

31 Differential equations that can be solved in this manner, i.e., via successive integrations, are said to be “solvable by 
quadrature.” 

32 Note that the right hand side verifies m for n = 0. 

33 That this holds for the OUP is also discussed on page 171 of m- 
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Finally by invoking (fUTT) and (f55j) we have the differential equation, 


d 1 <9 2 

- 1 = a(2/)^TOi(6»,y) + 


( 39 ) 


which can be solved for the first moment m\(9,y) subject to the boundary condition, 


mi(0, 9) = 0. 


Equations (l34l) and (l39l) are special cases of the0 

DARLING & SIEGERT MOMENTS RECURSION |5] 


-nm n - 1 (9,y) = a{y)—m n {0,y) 


\^(y)-^2 m n(o,y) 


(40) 


which is to be solved subject to the conditions, 

m-i(9,y)=0, mo(0,0) = l and m n (9,9) = 0 for n > 1. 

The recursion (l40ll is straightforward to derive for n > 10 assuming, for now, that (l27l) holds for the desired 
values of n. This is done by integrating all terms in Eq. (13^1) by — n / 0 °° t n : (• )dt, to obtain, 

~n j t n ~ 1 q g (y,t)dt = a{y)-^ J t n ~ 1 G g (y,t)dt S j + \p{y)-^ J t n - 1 G g (y 1 t)dt'j , 

which from Eq. C51) and (l3lT) immediately yields the moments recursion (1401) . 

There is an alternative derivation of flUl) that will allow us to replace the assumption that (E71) holds 
with the assumption of the existence of the passage time moments0 Because, 

d 

qe(y,t) = ——Gg(y,t), 

we have that Eq. (1331) yields the first passage time diffusion equation (FPTDE) for the first passage time 
probability density function, 

FPTDE 


d did 2 

-^.qe(y,t) = a{y)—q g (y,t) + ®(y,i) 

subject to qe(y,0) = 0 and q g (9,t) = 1 


(41) 


If we now integrate every term in this diffusion equation against we get, 

f°° d d Id 2 

J t n —q g (y,t)dt = a(y)—m n {y) + fn n (y). 

34 This recursion is given as Eq. (6.5) in [5]- For now it assumes that condition Eli holds, though this will be slightly weakened 
below and then replaced by the sufficient condition that the moments are assumed to exist. 

35 The case n = 0 has been handled separately above. 

36 The assumption of finite moments is the standard one encountered in the literature [5|- As mentioned previously assumption 
(|27j) is used in [6]. 

37 I.e., by /“ t n ( ■ )dt. 
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Then, integration by parts yields, 



t n -^q0{y,t)dt 



t n 1 qg(y,t)dt + lim t n qg(y,t), 

i—*oo 

v- ■ / 

■m n -i(6,y) 


so that, 


d Id 2 

-nm„- i(9,y) + lim t n qg(y,t) = a(y)—m n (y) +-/3{y)—^ m n (y). 

t-y oo ijy 2 oy z 


It is immediately apparent that the Darling & Siebert Moments Recursion (1401) holds if we assume that, 


lim t n q g (y,t) = - lim t n ^-Gg(y,t) = 0, 

t—t oo t—too (jt 


(42) 


a condition which should be compared to condition (1271) . Condition (1771) is equivalent to the condition, 


which is actually weaker than condition 


lim t" 1 Gg(y,t) = 0, 

t— »oo 


This is a consequence of L’Hopital’s rule, 


0 = lim t) = lim = lim s . 

t-y oo t-too t 1 n t—yoo (1 — n)t n 1 — n t-y oo dt 


lim t n ^-Gg(y,t). 


A sufficient condition for Eq. (1771) to hold, is that the ?i-th first passage time moment exist, 

nOO 

m n (9, y) = / t n q e (y,t)dt < oo. 

Jo 

We have thus demonstrated the standard sufficient condition for recursion (17()1) : 


Sufficient Condition for the Darling &; Siegert Moments Recursion to hold [5] 

Assume that nio(d, y) = 1. If all first passage time moments exist for n < n o, 

m n {0,y) < oo, (43) 

then the Darling & Siegert Moments Recursion (17U1) is valid for n < tiq. 


To actually verify condition (1431) in an a priori manner is usually nontrivial. It involves analytical and/or 
numerical knowledge of qg(y,t) which is obtained from solving the diffusion equation (1411) . This is generally 
a difficult task BE]- Because of the difficulty in verifying (1431) . we will henceforth assume that all first 
passage time n-th degree moments, n > 1, of interest exist. 

A necessary condition that moments exist for n > 1 is that mo(6 , y) = 1. This is because if mo(0, y) < 1, 
there must be nonzero probability mass at infinity which would case all moments n > 1 to be infinite So 
ideally, at the very least, one should verify that rrio{0,y) = 1. We do this for the OUP model in the next 
subsection. 

38 It is weaker because for the moments recursion lITOl to hold for the n-th moment on the right hand side, it is now sufficient 
for {23 to hold for only n — 1. 

39 This is discussed in ED- 
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We can solve Eq. (1401) to obtain a recursive formula expressing the moment m n (9 , y) in terms of the lower 
order moment m n -i(0,y). To do so let m n (y) = m n (9,y) and define, 

K( y ) =-^muiy), a(y) = and b{y) = -2 n ■ 

Then (for fixed 6) Eq. (14(1 becomes, 


dy 


m' n {y) + a(y)m' n (y) = b(y). 


(44) 


This is a linear, inhomogenous first-order differential equation that can be solved by the standard method of 
variation of parameters. The general solution is the sum of a particular solution, if>p(y), and a homogeneous 
solution, Co ip(y), where Co is a constant to be determined. For the homogeneous case, we have, 


dy 


+ a(y)i/)(y) = 0, 


which is solved by0 


ip{y) = exp j- J a(y')dy'^ = exp j-2 J J^ d v' 


A particular solution is then given by, 




Loo 4’iv') 

as can be readily checked. Thus, the general solution for m' n {y) is, 

™'n{ y ) = C 0 tp{y) +i/j p {y). 

Another integration yields, 


m n (y) = f (Co ip(y") + ipp(y")) dy" + C x 

J —oo 

Co exp | J u(y , )^2/ , | + '*/%") J dy " + Cl 


' — OO 

rv 


The boundary condition m n (6) = 0 leads to the choices Co = 0 and, 


Ci = - 




Then (note that y < 9), 


Thus we have shown that, 


mM = 2n l ^ [L mm dy ') dy " 

where tf>(y) = exp j-2 J <V j ■ 


(45) 


40 Similarly to the derivation to mo(y) done above, one more carefully would take the lower limit of integration to be i and 
then take t —> — oo to deal with terms involving nonconvergent integrals. We avoid this fussiness for now, but later we will have 
to bring the parameter t into the foreground in order to obtain sensible answers. 
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In the literature rather than working with ip(y), it is more common to see results written in terms of 

rl[v) =^{ 2 Lm dv '}- 

For this reason we define FI 

Wfe) = wX 1(v) = M exp { 2 /1 m iy ) ■ (46) 

Notice that the inclusion of the constant C in the definition of W(y) does not affect the formula in 
Eq. TO . and thus we can rewrite (H5l) as the, 

SIEGERT FORMULA [15] 

m " {v) = 2n I, wwm (/ 1 W<S> ”- I<!/)<V ) (47) 

with Wfe) = A I e x p{2 f 

This important relationship between consecutive moments of the passage time is referred to in the literature 
as the Siegert formula mm and is given as Equation (3.14) in Siegert’s original 1951 paper Pj FI 

2.6 Mean First Passage Time for the OUP 

We now use the theory developed in the previous section to show that the first passage time is finite with 
probability one and to compute the mean first passage time for the Ornstein-Uhlenbeck Process (OUP), 
which is given by the SDE m with, 

a(x ) = /U — kx, k > 0, and /3(x) = a 2 > 0, 


so that, 


dX = (p, — kx ) dt + a dW. 


As mentioned earlier dealing with the limit y —> —oo is a touchy issue. For this reason we proceed by 
setting the lower limits in the integrals of the Siegert formula which are at — oo to the finite value l and after 
having formed the final quantities of interest we will take the limit i —> — oo|ff] Thus we will proceed via the 
steps, 


function of 


J (■)dy 


—> function of 


J (')dy 


lim function of 


{■)dy. 


— OO 


e 


£ 


41 The quantity W (y) also has an important interpretation, it is often the case that C can be chosen so that W(y) is normalized 
to be a probability density function. In this case it is not hard to show that W ( x) is then the steady-state (t —> oo) probability 
density function which is the stationary solution to the non-thresholded (forward) Fokker-Planck Equation J13D , 

- + ^^( I ) W ( I ) = 0 
W(fc) = lim p(x,t\xo,to). 

t— »oo 

The derivation of W(x) as a solution to the steady-state Fokker-Planck equation is given in the Appendix. 

42 This formula also appears to have been independently discovered by Johannesma (see Eq. (15) in 0). Another early 
reference to the Siegert formula in the context of neuronal modeling is given in [J] (see Eq. (5.1) in this latter reference). 

43 The rigorous way to handle this case is to define the two boundary diffusion problem, i < x < 0, with appropriate boundary 
conditions at £ and 6. After the first passage time problem has been rigorously solve for this case, one can take £ —> — oo 
[8l 1121 [23l[6] . Rather than have to devote time to discuss the somewhat subtle issue of diffusion boundary conditions, in this 
note we have opted to work with improper integrals and evaluate expressions containing such integrals as appropriately defined 
limiting cases. 
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We begin by computing, 



The latter expression allows Eq. (1M1) to be written as, 

v 

I 

i 


rrio(6,y) = lim 


/exp{;M!,"-9 2 W' 

l K _ } 

I exp { £ (?/' - it) jdy' 1 


= 1, for all y < 0, 


£—±—oo ® 

f 

i 

showing that the probability of the OUP neuron firing in a finite time is oueF~1 


(50) 


Having shown that mo(y) = 1, from the Siegert formula (1771) and Eq. (1751) we can compute m-\ 


mi(y) =2 f 

j V 


dy' 1 


j3{y")\N{y" 


W (y')dy' 


= lim 2 

£ — y —oo 


= 2 


dy' 1 


a 2 exp \ -2 / f^dy' 


dy" 


exp < —2 


g(y) 

P{y) 


dy 


> dy' 


• y cr* exp < — 


{-£ (r 


(/l exp ( y ' - «) 2 } 


After some rearrangement and variable renaming this becomes the OUP/LIF Mean First Passage Time 
(OUP-MFPT) formula, 

44 See also Eq. (9.237) of |[2~l'l . Note that we have satisfied the necessary condition that all higher order moments exist. 

45 Assuming that it exists, mi(y) < oo. 
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Siegert formula for the OUP-MFPT 




mi(0,y) = 


yJL 

K 


e 2 (1 + erf(z)) dz = 


e 2 ( 14 - erf(z)) dz 


y ~K 

<y/y/n 




( 51 ) 


where erf denotes the error function. This result is well known in the literature. Reference 114] refers to it 
as the Siegert formula , despite its specialization to the case of the first moment, because it is readily derived 
from the general Siegert formula (1471) as we have done here. 

Via use of the general Siegert formula (1471) one can now proceed to derive the second moment of the first 
passage time for the OUP, and hence the variance of the passage time from knowledge of both the first and 
second moments. The form of the solutions (though not the details of the computations) can be found in 
m, though represented in term of the normal integral (which is closely related to the error function). 


3 Mean Firing Rate for the OUP/LIF Neuron 


Exploiting the fact that under the assumptions described in Section 1 the LIF subthreshold dynamics describe 
an Ornstein-Uhlenbeck process (OUP), we have been able to derive the mean first passage time (MFPT) for 
the neuron to hit the firing threshold after a reset at time t = 0. Specifically, MFPT as a function of the 
threshold value 0 and the membrane voltage reset value vq is given by Eq. (EH), 

T = T g (x o) = F,{T g (x 0 )} = mi{9,v 0 ). 


As discussed above, once the MFPT is at hand, the mean time-to-fire (MTF) of the OUP/LIF neuron, 

T f = E (T f ) =T r + E(T) = T r + T, 

is used to form the average firing rate (AFR) of the neuron, 

_ 1 _ 1 
P — Tf — 


T r + T 

Recall from Eq. © that of all the parameters that define the OUP/LIF neuron, only 

p = p(Io) = — V r + —I S yn + Jo 
r C 


(52) 


is generally under our immediate control. It is evident that the first two terms on the right-hand-side of this 
equation can have a confounding effect that must be compensated for. Given the relationship between fi(Io) 
and the injected current ([52]) . and recalling that, 

1 1 

RC’ 

we obtain the Siegert formula which shows how I 0 affects the mean firing rate for the OUP/LIF Neuron 
(LIF-MFR) in terms of the parameters defining the LIF-MFR neuron, 


Siegert formula for the LIF-MFR 
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As mentioned in the first section of this note, the OUP-LIF is a tremendously simplified model of 
neuronal dynamics. There is much research activity involved with relaxing the model assumptions. As one 
can imagine, determining the mean first passage time for more complex is a highly nontrivial endeavor. A 
low-order correction to the LIF-MFR (l53l) to partially account for synaptic capacitive effects is given in [3]. 
Further relevant modeling issues are discussed in the survey paper El- 


Appendix — Stationary Distribution of the Unrestricted FPE 

The Markovian probabilistic behavior of the homogeneous stochastic differential equation uni is described 
by the transition probability density function, p(x , t\xo, to), which is a solution to the (forward) Fokker-Planck 
Equation (fl3l) subject to the initial condition (THl) and the unrestricted boundary conditions (fl5l) . Under 
reasonable conditions on the SDE (flOl) . in the limit as t —> oo the pdf p(x, t\xo, to) converges to a steady-state 
density, \N(x), which is independent of the time, t, and of the initial information (xo,^o) [61l23j. 

W(x) = lim p(x, t\xo, to). (A.l) 

t—>oo 

Since in the limit the steady-state density W(x) is independent of the initial condition (fTTl) . and J^W(a;) = 0, 
it must solve the steady-state (forward) Fokker-Planck equation, 

--^a(x)\N(x) + i Jh P(x)\N{x) = 0, (A.2) 

subject to the boundary conditions (fT51) and the pdf normalization condition, 

/ \N{x)dx = 1. (A.3) 


Note that we can rewrite Equation (IA.2I) as 

■^(j3(x)\N(x) S J - 2a(x)\N(x) 

which yields, 


= 0 , 


d_ 

dx 


assuming that 


46 


d_ 

dx 


(^f3(x)\N(x)^ — 2a(x)W(x) = 0, 
(a(x)\N(x)^j 


x=—oo 


= 0 . 


x= — oo 


An additional integration yields, 


W(x) 


C 

flrA ex P 

pyx) 



(A.4) 


assuming that, 


(j3{x)\N{i 


= 0 , 


where C is a constant of integration. 

46 Note that these are stronger conditions than merely requiring that W(—oo) = 0. They correspond to conditions being 
placed on a(x) and (3(x) (i.e., on the SDE (HOD ). 
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Note the equivalence of equations C()l) and (IA.4I) . If we chose the constant C to ensure that \N(x) is a 
properly normalized probability density function, we obtain the following pdf as a steady-state solution to 
the Fokker-Planck equation, 


W(®) 


/3(x) 1 exp | 

2 / 

OO J 

> 

OO 

[2 7" 

) 

/ /3(a;") _1 exp < 

— OO 

> dx" 


(A.5) 


For the Ornstein-Uhlenbeck process (OUP) @ © we have, 

a(x) = ao — a\X = fi — kx and j3(x) = /3q = a 2 . 

This yields, 


\N(x) = lim 


exp - 

l^f (fi-Kx')dx' j 

> 

oo I 

' x" ] 

1 

/ expi 
—00 l 

f (fi — kx') dx’ 

k £ J 

> da;" 


exp * 

^j(fi-Kx')dx'^ 

> 

00 f 

' x" \ 

I 

/ expi 

— OO | 

J? / (fi — kx') dx' 

, 0 J 

> da;" 


exp (fix - ^kx 2 )} 

OO 

J exp {-^2 (fix" — \ k a:" 2 )} dx" 


exp < I f (n — k x') dx' + f (/j, — k x') dx' 

G Vo i 

= Inn -- 7 -r—s- 

(. — V —OO oo I / x" 0 \ I 

f exp < ^ ( f {fi — kx') dx' + J (fi — kx') dx' J > dx" 


Now note that, 


Thus, 


2 ( fix — 2 K3 ' 2 ') = ~ K f 2 ' 2 — 2— x + ~ ~2 * = ~ K I x ~ 


(*-*) 


2 , f * 2 


wo) = 


eX P {—^ ( a '~ k) 2 } 

/ exp{-^(x"-^) 2 }dx" 


or, 


which is a Gaussian pdf with mean ^ and variance ?—. This is a standard result FI 


“"E.g., see |21I . 


(A.6) 
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